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SUMMARY 


The  objective  of  the  Integrated  Nuclear  Communication  Assessment  (INCA) 
Program  is  to  determine  with  known  confidence  the  capability  of  the  National 
Command  Authorities  (NCA)  and  military  commanders  to  control  forces  in  a nuclear 
conflict  subject  to  nuclear  weapon  effects,  and  to  determine  those  measures  to 
assure  that  capability  with  known  confidence. 


Two  quantities  can  be  determined  for  the  components  within  a facility 
during  a nuclear  effect  assessment  program.  The  first  is  the  safety  margin 
expressed  as  the  dB  ratio  of  the  threshold  of  the  component  being  assessed  to  the 
input  to  the  component  induced  by  the  environment  under  consideration;  the  second 
is  the  data  quality  which  is  the  statistical  characterization  of  the  uncertainties 
associated  with  the  safety  margin  prediction  values. 

This  document  provides  the  results  of  studies  which  were  performed  to 
determine  techniques  for  1)  defining  the  prediction  uncertainties  for  nuclear 
effects,  and  2)  integrating  assessment  statements  for  various  nuclear  effects  into 
one  prediction  relationship  which  describes  the  survival  of  a communication 
facility  subjected  to  a combined  nuclear  environment. 
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1.0  INTRODUCTION 


The  Defense  Nuclear  Agency  (DNA)  has  undertaken  an  Integrated  Nuclear 
Communications  Assessment  (INCA)  Program  which  is  a multiyear  program  involving 
several  contractors  and  governmental  agencies.  The  objective  of  the  INCA  Program 
is  to  determine  with  known  confidence  the  capability  of  the  National  Command 
Authorities  (NCA)  and  military  commanders  to  control  forces  in  a nuclear  conflict, 
subject  to  nuclear  weapon  effects,  and  to  determine  those  measures  to  assure  that 
capability  with  known  confidence. 

The  objective  of  the  INCA  Program  is  being  met  by:  1)  developing  the 
necessary  analytical  methodologies  and  data  base,  including  test  data,  to  permit 
an  estimate  to  be  made  of  the  performance  of  Command  and  Control  Information 
Systems  (CCIS)  in  a nuclear  warfare  situation;  and  2)  applying  the  analytical 
methodology  to  evaluate  the  performance  of  selected  CCIS  elements  in  a nuclear 
scenario.  The  assessment  methodology,  analytical  techniques,  and  data  base  are 
being  structured  to  support  the  assessment  of  the  worldwide  CCIS  capabilities  in 
any  nuclear  scenario  considering  all  nuclear  weapon  effects  including  blast, 
thermal,  radiation,  electromagnetic  pulse  (EMP),  ground  shock,  dust,  ejecta  and 
magnetohydrodynamics  (MHD) . 

1.1  BACKGROUND 

Two  quantities  can  be  determined  for  the  components  within  a facility 
during  a nuclear  effect  assessment  program.  The  first  is  the  safety  margin  which 
is  the  dB-ratio  of  the  threshold  of  the  component  being  assessed  to  the  input  to 
the  component  induced  by  the  environment  under  consideration;  the  second  is  the 
data  quality  which  is  the  statistical  characterization  of  the  uncertainties 
associated  with  the  safety  margin  prediction  values.  A technique  has  been 
developed  (DNA  3859Z,  "Survivability/Vulnerability  Safety  Margin  Assessment"  dated 
30  September  1975)  to  determine  statistical  survivability  using  these  two 
quantities. 


The  technique  was  applied  following  the  analysis  and  testing  of  the 
Automatic  Electric  Company  (AeCo)  AUTOVON  switching  center  located  at  Delta,  Utah 
and  the  ESS-1  AUTOVON  switching  center  located  at  Pickens,  Mississippi. 
Electromagnetic  pulse  responses,  expected  to  be  Induced  during  the  test  programs, 
were  predicted  using  computer  analysis  techniques  prior  to  the  start  of  test 
activities.  Following  the  tests,  the  test  data  and  predicted  response  data  were 
analyzed  to  define  the  data  quality  applicable  to  the  electromagnetic  models. 

The  technique  used  to  determine  the  electromagnetic  pulse  (EMP) 
prediction  data  quality  required  the  use  of  data  obtained  during  test  programs 
using  EMP  simulation  sources.  The  INCA  Program  Is  scoped  to  Include  assessments 
for  nuclear  effects  which  cannot  be  adequately  simulated  during  test  programs. 
Thus,  techniques  must  be  developed  such  that  a prediction  data  quality  can  be 
determined  without  the  use  of  test  data.  Following  the  development  of  such 
techniques,  the  previously  defined  methods  can  be  utilized  to  define  a statistical 
assessment  statement  for  a specific  nuclear  effect. 

The  INCA  Program  will  be  the  first  program  which  attempts  to  Integrate 
several  assessment  statements,  for  various  nuclear  effects.  Into  one  overall 
assessment  statement  for  a communication  facility.  Consequently,  a technique  must 
be  developed  to  facilitate  these  assessment  statement  Integrations. 

1.2  SCOPE 

This  document  provides  the  results  of  studies  which  were  performed  to 
determine  techniques  for  I)  defining  prediction  data  qualities  for  nuclear  effects 
other  than  EMP,  and  2)  Integrating  assessment  statements  for  various  nuclear 
effects  Into  one  prediction  relationship  which  describes  the  survival  of  a 
communication  facility  to  a combined  nuclear  environment. 
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The  techniques  defined  assume  the  availability  of  accurate  Input  data 
and/or  controlling  equations.  As  for  all  analyses  of  physical  phenomenon,  the 
results  developed  using  the  techniques  presented  in  this  report  will  only  be  as 
accurate  as  the  input  data  and/or  equations  used  to  model  the  interactions  and 
mechanisms  that  control  system  survivability.  This  constraint  does  not  limit  the 
applicability  of  the  techniques  nor  is  the  constraint  unique  to  the  techniques. 

For  all  mathematical  analyses  of  physical  phenomenon,  the  analyst  must  develop 
analytical  equations  and  data  which  model  the  physical  reality.  Without  knowing 
the  actual  model,  the  analyst  cannot  place  "confidence"  characterizations  on  the 
analytical  model.  Instead,  he  must  assume  the  analytical  model  is  correct  and 
through  use  of  the  model  illustrate  that  analysis  results  do  not  disagree  with 
physical  realities  or  known  conditions.  However,  when  the  analysis  results 
disagree  with  physical  realities,  the  analysis  techniques  are  not  considered 
inadequate  - the  assumed  model  is  considered  incorrect  and  is  modified. 

The  material  contained  in  this  document  is  introductory.  That  is,  as 
with  all  Introductory  statistical  material,  liberal  use  of  normal  distribution  and 
statistical  independence  assumptions  are  made  to  simplify  presentations.  The 
techniques  presented  can  be  used  when  data  is  not  normally  distributed  or  when 
variables  are  not  statistically  independent.  However,  evolution  of  the  techniques 
requires  advanced  statistical  methods  and  should  be  accomplished  only  on  a 
case-by-case  basis  as  needed. 
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2.0  DATA  QUALITY/CONFIDENCE  FOR  EACH  EFFECT 


The  material  presented  in  this  section  defines  techniques  which  can  be 
used  to  characterize  the  data  quality  associated  with  a safety  margin  prediction 
method.  The  techniques  defined  vary  from  those  which  incorporate  test  data  to 
those  which  use  purely  analytical  methods. 


2.1  TEST  VERIFICATION 

Determining  prediction  data  quality  by  test  verification  involves 
predicting  response,  performing  a test  to  measure  the  actual  response,  and  using 
the  differences  between  predicted  and  measured  response  to  define  prediction 
uncertainty.  It  is  the  most  straightforward  and  intuitively  satisfying  method,  but 
is  expensive  due  to  the  required  test  activities.  It  should  be  pointed  out  that 
the  value(s)  obtained  during  a test  are  not  the  true  value(s)  of  the  quantities 
being  measured;  thus,  the  test  measurement  uncertainties  must  be  included,  if 
possible,  during  any  analysis  resulting  in  a definition  of  the  predictions 
uncertainty  based  upon  comparisons  of  predicted  and  test  results. 

2.1.1  Predictions 

To  determine  the  p. ediction  uncertainties  associated  with  a prediction 
method  or  technology,  it  is  important  to  establish  and  define  the  procedures  and 
level  of  effort  which  are  Included  in  the  prediction  method.  This  definition 
should  include  the  qualifications  of  personnel  developing  the  predictions,  the 
time  allotted  to  obtain  the  predictions,  the  theoretical  and  .computational 
concepts  used,  the  level  of  detail  modeled,  and  the  degree  to  which  physical 
parameters  are  known  or  must  be  approximated.  This  definition  should  be 
established  to  assure  that  all  concerned  understand  the  technique  to  which  the 
eventually  determined  prediction  data  quality  may  be  applied. 


In  practice,  predictions  will  be  made  for  many  points  within  a facility 
under  examination.  A subset  of  thfSft  points  will  be  tested  for  the  purpose  of 
determining  prediction  uncertainties.  Sample  theory  concepts  should  be  applied  to 
determine  the  sample  size  and  the  selection  of  the  subset. 

As  a first  step,  the  sample  unit  must  be  defined.  This  is  usually  a 
simple  decision  and  consists  of  determining  whether  a sample  unit  consists  of  a 
component,  a circuit,  an  equipment  rack,  or  all  racks  of  a given  level  of 
predictive  complexity.  Combinations  of  units  may  be  selected.  However,  data 
quality  characterizations  should,  whenever  possible,  be  developed  for  homogeneous 
sample  unit  groups  since  the  data  quality  varies  group-to-group.  As  an  example, 
the  data  quality  for  rack-level  predictions  is  generally  better  than  for 
component -level  predictions  since  additional  details  must  be  characterized  when 
moving  the  prediction  points  from  the  rack  level  to  the  component  level. 

Since  testing  to  determine  data  quality  is  essentially  a problem  of 
estimating  variance,  the  required  sample  size  can  be  approximated  for  a nearly 
normal  distribution  by  using  the  Chi-squared  distribution  if  the  required  or 
desired  accuracy  is  fixed.  This  statistical  problem  is  treated  in  introductory 
mathematical  statistics  texts  and  is  briefly  addressed  in  Appendix  A.  For 
populations  which  are  not  normally  distributed,  or  near-normal ly  distributed,  more 
advanced  techniques  are  necessary  to  determine  the  required  sample  size.  Such 
techniques  are  outside  the  scope  of  this  report  but  can  be  found  in  advanced 
statistics  texts. 

The  selection  of  the  points  for  which  predictions  are  made  should 
assure,  to  the  extent  possible,  that  a representative  sample  is  selected; 
techniques  for  selecting  representative  samples  are  defined  in  all  statistics 
texts  which  address  sampling  theory.  If  more  than  one  type  of  sample  unit  exists, 
the  selected  sample  units  should  include  the  spectrum  of  types  of  sample  units  for 
which  predictions  are  established.  The  proportions  of  types  of  sample  units  in  the 
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sample  should  approximate  the  proportion  of  prediction  unit  types  in  the  facility 
or  weighted  statistics  should  be  utilized.  This  selection  technique  avoids 
intentional  or  inadvertent  testing  of  a high  proportion  of  units  for  which 
prediction  variability  is  relatively  low  or  high. 

The  selection  of  test  measurement  points  should  assure,  to  the  extent 
possible,  that  a random  sample  is  selected.  The  intent  is  to  avoid  a test  sample 
that  is  different  in  an  important  way  from  the  whole  set  for  which  the  test 
results  are  expected  to  apply.  Randomness  can  be  assured  in  part  if  no  special 
prediction  analysis  or  review  is  conducted  on  test  points  that  is  not  normally 
conducted  for  prediction  efforts  which  are  not  verified  by  test. 

Predicted  responses  may  be  given  in  terms  of  several  variables  or  a 
continuum  of  values.  An  attempt  should  be  made  to  reduce  the  response  prediction 
to  one  "most-important"  variable  (failure  power,  voltage,  current,  predominant 
frequency,  etc.),  or  a small  number  of  variables,  to  allow  a clear  character- 
ization of  the  important  prediction  uncertainies.  Many  techniques  exist  for 
determining  the  "most-important"  variable;  the  technique  commonly  employed 
consists  of  utilizing  partial  differentiation  procedures  to  determine  which 
independent  variable(s)  significantly  affect  the  dependent  variable. 

2.1.2  Tests 


If  more  than  one  test  method  is  available,  the  selection  of  the  test 
method  should  take  cost  and  the  verified  ability  to  meet  accuracy  requirements 
into  consideration. 


An  analysis  must  be  made  to  determine  the  uncertainties  of  the  test 
measurement  method.  Bias  is  the  difference  between  the  average  measurement  and  the 
true  value  of  the  quantity  measured;  a zero  bias  measurement  method  is  desired 
such  that  the  expected  value  of  the  quantity  being  measured  is  equal  to  the 
measurement  value.  Reproducibility  of  a measurement  is  defined  by  the  variation 
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about  the  average  for  the  same  test  point  and  test  methods.  The  bias  and 
reproducibility  of  the  test  measurement  method  should  be  used  in  the  data  quality 
analysis,  and  may  be  used  in  determining  the  desired  number  of  measurement 
repetitions  required  if  measurement  averages  are  to  be  used  to  reduce  test  errors. 
Test  data  cannot  be  used  to  quantify  prediction  uncertainty  unless  the  uncertainty 
bound  of  test  measurements  is  significantly  less  than  the  expected  prediction 
uncertainty. 

2.1.3  Statistical  Data  Reduction 

It  will  be  assumed  herein  that  the  response  prediction  can  be  reduced  to 
a "most-important"  variable;  that  is,  the  variable  which  predominantly  influences 
the  facility  survivability.  If  the  response  predictions  are  affected  by  many 
variables,  then  the  procedures  identified  must  be  expanded  or  modified  to  handle 
the  more  complex  problem. 


Usually  only  one  prediction  of  the  expected  variable  value  will  be  made 
for  each  point,  and  this  procedure  will  be  assumed  here,  although  expansion  of  the 
techniques  presented  herein  to  methods  employing  several  predictions  at  a point  is 
relatively  simple.  Let  pj  be  the  prediction  value  for  point  j. 


One  or  more  test  measurements  will  be  made  at  each  point;  the  general 
n-measurement  case  will  be  assumed  herein.  Let  t^j,  i*l,2...,n  represent  test 
measurement  i at  point  j. 


For  each  test  point,  the  mean  test  measurement  value  must  be  calculated. 

If  later  analysis  includes  a logarithm  conversion,  such  as  to  the  dB  domain,  the 
n 

geometric  mean  ( >r  tf j )^/n  should  be  calculated  because  the  logarithm  of  the 
i*l 

geometric  mean  is  equal  to  the  arithmetic  mean  of  the  test  measurement  value 
logarithms. 

During  test  data  reduction  for  a test  point  with  n>2,  a check  should  be 
made  for  outliers  that  may  be  due  to  bad  test  setups,  mislabeling,  or  similar 
mistakes.  If  the  tjj  values  at  a point  are  approximately  normally  distributed  and  a 
is  the  repeatabil ity  standard  deviation  for  the  test  method,  t*  would  be  a 
suspected  outlier  (a«  .001)  if  |t*  - t | >3 . 3a . If  an  outlier  is  detected,  then  the 
outlier  should  be  examined  to  determine  the  reason(s)  that  the  value  does  not 
conform  with  the  remaining  data.  If  there  is  good  reason  to  believe  that  the 
outlier  is  an  incorrect  value,  the  mean  can  be  approximated  by  using  the  median 
(reference  1).  If  several  outliers  are  suspected  in  a large  sample,  these  can  be 
detected  using  special  tests,  and  parameters  can  be  estimated  using  trimmed  or 
Winsorized  estimators  (reference  2). 

The  differences  between  predicted  and  measured  responses  can  be  defined 
by  several  different  statistics.  Examples  are  the  statistics  Pj-tj,  Pj/tj,  and  log 
(pj/tj).  The  selection  of  which  statistic  to  use  depends  on  the  possible  values  of 
Pj  and  tj,  and  the  resulting  distributional  form  of  the  chosen  statistic.  Analysis 
is  usually  simplified  if  the  statistic  chosen  is  approximately  normally 
distributed. 

For  electronic  communication  systems,  prediction  errors  tend  to  arise 
from  many  small  multiplicative  errors.  This  causes  the  logarithm  of  prediction 
errors  to  follow  a normal  distribution  (reference  3). 
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In  the  following  discussions,  the  logarithmic  transformation  to  a 

decibel  measure  of  error,  xj  « 20  log  (pj/tj),  will  be  used  where  j denotes  the 

n 

test  points,  j*l ,2,  ....  m,  and  tj  the  geometric  mean  (^*  tij)1/". 


As  a first  analysis  step,  the  hypothesis  that  X Is  a normally 
distributed  random  variable  must  be  statistically  tested.  If  the  hypothesis  Is 
rejected.  Investigation  of  alternative  statistics  or  distributions  must  be 
performed.  The  test  for  normality  should  be  a goodness-of-f 1 t test  such  as  the 
Cramdr-vonMIses  test  (reference  4),  the  W test  (reference  3),  or  a Chi -squared 
test  If  the  sample  is  quite  large  (reference  5). 
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Following  the  distributional  tests,  the  hypothesis  that  Ux*C)  (l.e.,  that 
there  is  no  bias  in  the  prediction  method)  must  be  examined.  If  the  hypothesis  Is 
rejected,  the  prediction  data  quality  characterization  must  be  defined  to  Include 
a prediction  bias  term. 


The  statistical  test  of  the  hypothesis  that  »x"0  when  xj  Is  a sample 
from  a normal  distribution  Is  a standard  textbook  use  of  the  student's  t 
distribution  (reference  3).  If  the  hypothesis  Is  rejected,  the  bias  estimate  Is 
Tx  j 

b ■ and  the  data  quality  statistic,  defined  as  DQ  * 3c,  Is  characterized  by 

m 

OQ  * 3( L(xj  - b)2/(m-l))1/2.  If  the  hypothesis  Is  accepted,  the  prediction  data 
quality  statistic  can  be  defined  as  DQ  ■ 3(r  xj2/m)l/2. 

These  data  quality  statistics  Include  the  errors  due  to  the  measurement 
system  uncertainties  as  well  as  the  uncertainty  errors  In  the  predictions.  If  the 
predictions  fall  within  the  range  of  the  measurements,  much  of  the  prediction 
uncertainty  defined  may  be  due  to  measurement  system  acquisition  errors.  In  order 
to  obtain  an  estimate  of  prediction  uncertainty  with  measurement  errors  removed, 
the  following  method  of  Taylor  expansion  about  system  function  (reference  3)  may 
be  used: 


Let: 


xj  " h {pj*  llj*  l2j tnj)  " 20  ,og  (pj/tj) 

n 

■ 20  log(p.)-(20/n)  E log  t.. 

J i>|  'J 

and  note  that  xj  Is  In  the  dB  while  pj  and  tjj  are  in  the  original  units. 
Using  the  expansion  formula  for  r * h (Si,  S2,  S*), 

v*r  <r>  ■ (s'-’  * L,  !r 


results  In  a variance  of  xj  defined  as: 

,2 


Var(x.)*(  20  log  e)' 


► 

(1/p. 


)2  Var  (p.)  + ( 1/n2) 


Li,  0/,‘)2] 


Var(t)|  +g(u^) 


where  Var  (t)  is  the  uncertainty  variance  for  the  test  measurements  and 
e = 2.71828...  . The  g( U3 ) terms  may  be  dropped  when  pj  and  t{j  are  approximately 
synmetrlcally  distributed  random  variables. 


Then, 


Var  (P.)  " p.2  (Var  (x.)/(20  log  e)2  - Var  (t)  Z 0/t.)2/n2 
J J I J i-|  1 


for  an  Individual  prediction  pj  at  point  j which  has  n test  measurements. 

Using  Sx*  for  an  estimate  of  Var  (xj)  and  pooling  the  estimates  of  Var  (Pj)  over 
the  m prediction  points  gives: 

m 


( I/m) 

l 

Var 

(p  ) 

j"' 

J 

(I/m) 

m 

Z 

2 

Pj 

U 

j"l 

l 

n 

£ 

i*l 


,2,2 


as  an  estimate  of  the  prediction  uncertainty  variance  with  measurement  errors 
removed. 
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If  the  test  method  uncertainty  is  much  less  than  the  prediction  uncertainty,  then 


j 

y 

I f 


j 

, 

! 

1 

j 

t 

i 


V ar(p)i(Sx2  p2/ [20  log  e]2) 


If  the  test  method  uncertainty  variability  Is  much  greater  than  the  prediction 
uncertainty,  then  the  estimate  of  Var  (p)  becomes  unreliable  and  Var  (p)  may  be 
estimated  better  by  a subjective  evaluation  of  its  approximate  value. 

2.1.4  Data  Quality 

The  above  development  leads  to  a statement  of  prediction  uncertainty  for 
a single  response  variable,  such  as  the  peak  voltage  response  at  a point  due  to 
electromagnetic  simulation  of  a communications  facility.  Typically  another 
variable  must  be  predicted,  such  as  the  damage  threshold  of  the  component  at  the 
prediction  point,  in  order  to  characterize  the  degree  of  safety  which  exists  for 
the  threat  being  analyzed. 

For  r and  q in  dB,  if  1)  Var  (r)  Is  the  prediction  uncertainty  variance 
for  the  response,  after  adjusting  for  known  bias,  2)  Var  (q)  Is  the  prediction 
uncertainty  variance  for  the  threshold,  and  3)  the  degree  of  safety  is 
characterized  by  a safety  margin  estimate,  a,  defined  as  a * q - r * 20  log 
(threshold/response),  then  the  prediction  uncertainty  for  the  safety  margin 
estimate  is  given  by  the  variance  Var  (a)  * Var  (q)  + Var  (r). 

If  prediction  errors  for  q and  r are  normally  distributed,  then  the 
prediction  errors  for  the  safety  margin  estimate  are  normally  distributed  with 
standard  deviation  aa  * (Var  (a))l/2.  As  such,  the  probability  that  the  true 
safety  margin  is  greater  than  0 (i.e.,  that  the  component  at  the  prediction  point 
is  safe)  is  Pr(Y<a)  for  Y distributed  as  N(0,  oa). 
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2.2 


METHOD  OF  MOMENTS 


In  some  cases  and  for  some  effects,  test  validation  of  predictions  Is 
not  feasible.  However,  If  the  equations  used  to  make  the  predictions  can  be 
exprrssed  In  closed  form  and  satisfy  certain  regularity  conditions,  and  If  the 
distributions  of  estimation  errors  of  the  Independent  variables  are  known,  then 
the  moments  of  the  uncertainty  probability  distribution  for  the  prediction  value 
can  be  calculated. 

The  method  used  Is  the  "method  of  generation  of  system  moments."  It 
consists  of  making  a Taylor  series  expansion  about  the  expected  values  of  the 
Independent  variables.  Once  the  distribution  moments  about  the  prediction  value 
are  estimated,  the  percentiles  of  the  distribution  can  be  estimated. 

In  theory,  any  number  of  higher  moments  can  be  estimated.  In  practical 
cases  with  limited  data,  the  estimators  of  the  higher  moments  of  the  probability 
should  be  limited  to  the  first  and  second  moments  of  the  distribution  of  the 
system  prediction  values. 

A more  exact  method,  transformation  of  variables  (reference  3, 
page  175),  can  be  used  on  very  simple  problems.  The  method  is  not  treated  here 
because  It  can  rapidly  become  very  Involved  for  moderately  complex  system 
functions. 


2.2.1  Technique 

Let  the  system  prediction  Z and  the  equation  variables,  xi,  x£,  ...,  xn, 
be  related  by  the  function  z*h(xi,  X£,  ...,  xn).  Let  E(xj)  be  the  expected  value 
or  mean  for  the  equation  variable  1,  and  let  ugUi)  denote  its  Kth  moment  about 
the  mean  (uk  ■ E (xj  - uiUj))*).  Let  Var(xj)  be  the  variance  or  second  moment. 
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Higher  order  terms  can  also  be  calculated  (reference  3,  page  256  and  reference  6) 


If  the  equation  variables  are  all  statistically  Independent 
(f(xi|xj,  xs)  * f ( x-j ) ) , then  the  Taylor  series  expansion  simplifies  to 

r(z)»h  [E(x  ),E(xJ E (x  )]  ♦1/2  E Var  <x.) 

12  " l-l  3xj  ‘ 


and 


Var (z)a 


i,  (fir) 


Var  (x.)  + 


Uj(x.) , 


These  expressions  are  approximations  in  that  they  Ignore  higher  order  terms  by 
assuming  they  equal  zero. 


The  partial  derivatives,  which  are  evaluated  at  the  means,  must  exist 

for  the  method  to  be  used.  Similarly,  the  resulting  expected  values  must  be 

1 

finite.  These  requirements  can  be  satisfied  for  most  physical  systems. 

2.3  SENSITIVITY  ANALYSIS 


When  test  validation  of  predictions  is  not  feasible,  and  when  the 
prediction  technology  Is  so  complex  that  closed  form  expressions  for  prediction 
equations  are  not  available,  then  prediction  uncertainty  must  be  estimated  using 
other  methods.  An  example  of  such  a case  might  be  an  electrical  network  analysis 
using  computer-aided  techniques.  The  methods  which  can  be  used  to  determine 
prediction  uncertainty  include  the  joint  or  separate  use  of  worst-case  analysis, 
sensitivity  analysis,  or  simulation  techniques.  The  approach  consists  of 
repeatedly  assuming  values  for  the  variables  of  the  analysis  system  and  evaluating 
the  resultant  prediction  variability. 

Let  the  system  prediction  for  a nuclear  effect,  Z,  and  the  analysis 
variables  xi,  X2,  ....  and  xn,  be  related  by  the  Implicit  function 
Z * h(xi,  X2,  ....  xn). 
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2.3.1  Worst-Case  Analysis 


A worst-case  analysis  approach  may  save  time  if  the  purpose  of  the 
analysis  is  to  eliminate  the  necessity  of  considering  a nuclear  effect  during 
further  analyses.  The  approach  is  formulated  to  show  that,  even  if  the  x,  values 
all  take  on  unfavorable  extreme  values,  the  resulting  worst-case  system  prediction 
(Zw)  allows  for  discontinuing  further  consideration  of  the  effect. 

The  following  simple  procedure  can  be  used  for  worst-case  analysis  under 
the  conditions  that:  1)  the  nature  of  the  possible  variations  in  x^  are  known  for 
all  i,  and  2)  the  direction  of  change  in  Z for  a given  change  in  xj  is  known  and 
interaction  effects  between  variables  are  not  strong  enough  to  fully  counteract 
this  change. 


Assume  for  expository  simplicity  that  the  worst  case  Z is  the  maximum  Z 
that  could  reasonably  result  from  a set  of  x^,  i*l,n.  The  worst  case  x^  is 

obtained  using  the  following  procedure:  for  each  x< , if  >0,  pick  x-jY  such  that 

uX  j 

the  probability  of  {xj  > x,y)  is  y;  if  ^ <0,  pick  x-jy  such  that  the  probability 

of  {Xj  i x^y)  is  y where  y is  arbitrarily  selected  and  denotes  the  level  of 
significance  for  the  worst  case  analysis.  Thus,  if  one  must  include  ail  x^j  - 
oarameters  which  potentially  affect  Z,  to  a 0.99  confidence  level,  then  y is 
choosen  as  1 - y « 0.99  or  y * 0.01.  As  noted  above,  the  x^y  values  cannot  be 
determined  unless  the  nature  of  the  possible  variations  in  x^  are  known.  As  an 
example,  if  X4  is  distributed  uniformly  with  a mean  of  X4  and  a half-width  of  a 

then,  for  y * 0.05,  [X4  £ X4Y]  and  [X4  x'4y]  where  X4Y  * X4  + 0.9a  and 

x'4y  ■ X4  - 0.9a. 

Calculate  Zw  * h (x^y,  xjY,  ...,  XnY)  which  is  the  worst-case  estimate 
of  Z.  The  probability  of  (Z  > Zw}  is  not  greater  than  y;  that  is,  Z is  less  than 
or  equal  to  Z*  with  probability  greater  than  or  equal  to  (1  - y).  .Since  the 
confidence  coefficient  associated  with  a confidence  interval  is  simply  the 
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probability  that  the  quanitity  is  Included  in  the  Interval,  then  the  confidence 
interval  (Z _<  Zw>  Is  associated  with  the  confidence  coefficient  equal  to,  or 
greater  than,  (1  - y). 

The  confidence  coefficient  may  be  much  greater  than  (1  -y)  if  several  Xj 

have  approximately  the  same  —■  , or  may  be  quite  close  to  (1  -y)  if  one  x-j 

Ax1 

dominates  changes  in  Z.  The  exact  value  for  the  confidence  coefficient,  or  of  the 
variance  of  the  predictions,  need  not  be  known  since  it  is  only  necessary  to 
demonstrate  that  the  upper  bound  of  possible  predictions  is  sufficiently  small  and 
that  the  nuclear  effect  can  be  ignored. 

2.3.2  Sensitivity  Analysis 

Sensitivity  analyses  are  used  to  Identify  any  Xj  which  has  a negligible 
effect  on  Z.  If  several  x-j  variables  can  be  ignored,  one  of  the  other  analyses 
techniques  for  determining  data  quality  may  become  practical.  As  an  example, 
simplification  may  allow  use  of  closed  form  equations  that  permit  calculation  of 
system  moments. 

The  following  simple  procedure  can  be  used  for  sensitivity  analysis 
under  the  conditions  that:  1)  the  nature  of  the  possible  variations  in  Xj  are 
known  for  all  1 being  analyzed,  and  2)  the  derivative^-  is  less  than  or  equal  to 
zero  for  all  values  of  x-j,  or  Is  greater  than  or  equal  to  zero  for  all  values  of 
xj  (i.e.,  monotonlcally  increasing  or  decreasing). 

To  Implement  the  analysis,  select  Xjj_  and  Xju  values  such  that  the 
probabilities  of  (xj  i XjL>  and  (xj  > xju)  are  each  equal  to  a.  Following  this 
selection  process,  calculate 

AZj  » h (xj,  X2,  ...,  Xju,  »..,  xn)  - h (xj,  X£,  ...,  xj|_ xn) * 

where  the  value  for  Xj,  1>*j , is  numerically  close  to  the  expected  value  of  Xj.  The 
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median  can  be  used  for  most  distributions  and.  If  the  distribution  Is  symmetric, 
the  mean  value,  (xju  - Xi|_ )/2,  can  be  used  as  the  value  of  xf.  As  an  example,  let 
Z * 3x^  + 2x2x3  - X4  where  xj,  X2,  . • • X4  are  symetrically  distributed.  Then 

AZ1  ■ (3xJu  + 2x2x3  - X4)  - (3x^l  + 2x2x3  - X4)  * xf„  - x^L 


and 


AZ3  - (3x^  + 2X2X3U  - X4)  - (3xjf  + 2x2X3L  - X4)  * 2x2  (*3u  “ *3t) 

To  complete  the  analysis,  determine  the  maximum  AZj,  denoted  as  AZ,^, 
for  all  i,  1*1,  ...,  n. 


The  criteria  for  determining  which  variables  can  be  ignored  must  be 
developed  based  on  analysis  requirements  for  the  system.  An  example  criteria  is: 


1 

max 


then  delete  variations  in  the  parameter  denoted  by  x^  from  consideration. 


The  procedure  as  stated  above  ignores  interaction  effects.  If  a 
particularly  strong  interaction  effect  is  suspected,  it  can  be  similarly  evaluated 

as  A Zfj  -h  (xi,X2,...,xiu Xju xn)  -h  (xi,X2 ,xn),  and 

both  X{  and  xj  should  be  retained  if  (az^j  - az,  - AZj)  is  not  negligible. 

2.3.3  Simulation 

If  the  degree  of  uncertainty  in  the  values  of  x^  is  such  that  the  values 
may  be  characterized  as  random  variables  selected  from  a population  following  a 
definable  probability  distribution,  simulation  techniques  may  be  used  to  estimate 
the  prediction  uncertainty  of  Z.  This  technique  is  feasible  for  complex  prediction 
technologies,  especially  those  that  are  computer  based. 
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The  basic  technique  consists  of  using  random  number  generators  to  create 
sample  vectors  vj  * (xj,  X2,  ...»  xn)  for  which  x,  is  a value  generated  from  the 
distribution  characterizing  x^.  After  determining  the  vj  vector,  Zj  * h(vj)  is 
calculated.  This  process  is  repeated  m times;  the  distribution  of  the  m generatred 
values  of  Zj  can  then  be  used  to  characterize  the  uncertainties  in  the  prediction 
technique.  The  technique  can  be  used  for  cases  where  x,  and  X|<  are  not  independent 
if  the  random  number  generator  is  designed  to  generate  correlated  random  numbers. 

Uncertainties  as  to  the  true  relational  form  can  be  handled  using  this 
technique.  If  the  subjective  estimate  of  the  probability  that  hj  is  the  true  form 
for  h is  and  the  probability  that  h2  is  the  true  form  for  h is  <t>2;  then  m^  and 
samples  can  be  run  using  models  hj  and  h2,  respectively,  where  mi/m2  = 

The  resulting  distribution  of  (Zlmj,  m2)  would  then  include  prediction  variability 
due  to  uncertainty  as  to  the  true  functional  form. 

Gathering  data  on  distributions  of  input  parameters,  and  performing  each 
of  the  m iterations  in  a simulation  study,  can  be  quite  expensive.  Preliminary 
sensitivity  analysis  to  eliminate  variables  may  be  beneficial  in  reducing  the  data 
analysis  required,  and  may  allow  for  the  implementation  of  an  approach  other  than 
simulation.  Preliminary  analysis  to  define  the  required  precision,  or  acceptable 
bounds  for  the  estimate  of  the  variance,  will  help  limit  the  required  number  of 
simulation  iterations. 
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3.0  PROBABILITY  OF  SURVIVAL  FOR  INTEGRATED  EFFECTS 

3.1  DEFINED  SCENARIO  METHOD 

One  method  of  determining  probability  of  survival  is  to  hypothesize  a 
scenario  with  one  or  more  bursts  at  specified  locations,  and  to  analyze  the 
probability  of  survival  for  these  conditions.  The  scenario  analysis  described 
here  is  appropriate  for  a single  node,  link,  or  any  other  simple  serial  system. 

More  complex  systems  of  redundant  nodes  and  links,  which  have  non-zero 
or  non-one  probabilities  of  survival,  require  further  analysis  by  simulation  or 
application  of  network  or  reliability  theory  (Appendix  B). 

3.1.1  Environment  Characterization 


The  parameters  given  to  characterize  the  burst  must  be  sufficient  to 
define  each  nuclear  effort  to  be  studied.  Typical  parameters  would  include 
latitude,  longitude,  height,  fission  yield,  time  of  day,  surface  material 
composition,  and  possibly  status  of  previous  burst  effects  or  the  number  of 
simultaneous  bursts.  The  phenomenological  sciences  of  physics  or  nuclear  test 
history  can  then  be  applied  to  this  burst  characterization  to  deduce  the 
magnitude  of  any  of  several  effects  Ej,  j*l,  ...»  e. 

The  analysis  is  effectively  a simulation  of  the  attack  scenario.  In 
the  real  situation  there  is  uncertainty  both  in  targeting  and  design,  and  in 
realizable  targeting  accuracy  and  construction  ability.  The  scenario  method 
usually  bypasses  these  uncertainties  by  treating  the  burst  parameters  as  given 
values  of  the  scenario. 


» 
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Expressed  in  other  terms,  the  analysis  of  the  original  problem. 


Pr  (Survive  I Attack  Scenario), 

is  made  more  tractable  by  substituting  for  it  the  scenario  based  analysis  of 

(Pr  (Survive  I Attack  scenario  with  given  parameters), 

but  the  variability  in  the  estimate  of  the  probability  of  survival  is  more 
properly  stated  with  reference  to  the  original  problem.  This  statement  of 
variability  may  be  impossible  to  define  objectively  or  qualitatively,  but  the 
results  of  the  analysis  should  reflect  at  least  qualitatively  the  implied 
uncertainty  from  using  the  substitute  analysis.  If  it  is  desired  to  examine  the 
implications  of  the  uncertainty  in  the  burst,  several  different  scenarios  may  be 
hypothesized  and  separately  analyzed. 

3.1.2  Nuclear  Effects 

A burst  has  many  interrelated  effects  which  cin  affect  a node  of  a 
communication  system.  Blast,  shock  waves,  thermal  ignition  or  melting,  transient 
radiation,  trapped  radiation,  electromagnetic  pulse  (EMP),  system  generated  EMP 
(SGEMP)  from  gamma  or  X-rays,  dust  and  debris,  ejecta  from  ground  bursts, 
magnetohydrodynamics  (MHO),  and  particle  fallout  are  effects  that  may  separately 
or  jointly  affect  nodes  or  links. 

The  effects  may  result  In  physical  impairment  of  facilities  and 
equipment,  impairment  of  signal  propagation  or  noise  characteristics,  or 
disabling  of  personnel.  The  system  elements  affected  can  include  nodes  such  as 
land  facilities,  aircraft,  and  satellites;  network  links  such  as  landlines;  or 
the  atmosphere,  the  ionosphere,  or  free  space. 


3.1.3  Integration  of  Assessment  Results 

An  analysis  of  survivability  of  a node  Is  facilitated  by  defining  a 
matrix  describing  subunits  of  equipment  versus  the  separately  definable  nuclear 
effects.  For  any  one  of  these  combinations,  let  Q(1,j)  be  the  probability  of 
survival  of  equipment  1 under  nuclear  effect  j.  Exactly  what  constitutes 
"survival"  must  be  carefully  defined  for  each  unit  of  equipment  In  terms  of 
operation  of  the  node  or  link.  In  general,  survivability  Is  properly 
characterized  as  a probability,  due  to  variability  In  parameters  of  the 
equipment  and  protective  features,  and  due  to  analytical  uncertainties  In 
estimating  thresholds  and  attenuation  of  nuclear  effects  within  the  node.  For 
analysis  of  survivability,  knowing  the  source  of  the  uncertainty  Is  not 
critical,  though  knowing  the  source  may  become  important  for  decisions  as  to 
whether  tj  harden  the  Installation  or  perform  a more  precise  analysis. 

An  over-simplified  model  for  the  probability  of  survival,  0(1 ,j), 
versus  an  independent  variable  that  modulates  the  nuclear  effects  (range,  for 
example)  may  be  given  as  a step  function  as  Illustrated  In  Figure  3.1-1. 


r.  (range) 


Figure  3.1-1 . Step  survivabi ) i tv  function. 


Taking  into  account  variability  In  parameters  of  components  between 
units  and  over  time  of  day,  temperature,  humidity,  age,  etc.,  the  model  for  Q 
can  be  represented  as  an  S curve  as  shown  In  Figure  3.1-2.  In  this  model  there 
are  random  variations  In  the  true  range  at  which  the  equipment  will  survive, 
such  that  rest  * Rtrue  + 0 • where  p Is  a random  variable  which  has  a probability 
distribution  that  may  be  estimated  by  analysis,  simulation,  or  test. 
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r2  r3 


Range 

Figure  3.1*3.  Bounded  S-shaped  survivability  function. 


An  example  interpretation  of  Figure  3.1-3  is  that  the  probability  of 
survival,  Q,  is  estimated  to  be  qi  at  a range  of  r2,  and  in  view  of  the 
analytical  uncertainties,  the  true  range  at  which  Q is  equal  to  qi  is  less  than 
r3  with  confidence  of  1 -a.  In  addition,  there  is  a probability  a that  the  range 
at  which  Q is  equal  to  qi  is  less  than  rj.  Figure  3.1-4  shows  the  relationship 
between  range  and  the  confidence  that  R is  less  than  or  equal  to  r at  a fixed 
probability  of  survival,  qi. 


Conf I dence 
R « r 


Figure  J.l-4.  Confidence  for  fixed  Q from  figure  3.1 — 3. 


Another  1 nterpretatl on  for  a given  range,  rj,  may  be  made  from  Figure 
3.1-3  as  redrawn  In  Figure  3.1-5.  The  confidence  or  probability  that  the  true 
range,  R,  at  which  Q Is  equal  to  qi  is  greater  than  ri  Is  1 -a.  Similarly, 

Pr  ((R  such  that  Q*q3)  2 rj > * a.  Figure  3.1-6  shows  the  relationship  for  the 
confidence  that  R Is  greater  than  or  equal  to  fixed  ri  for  various  probabilities 
of  survival,  as  might  be  determined  from  the  relationship  In  Figure  3.1-5. 


Q 


Range 

Figure  3.1-5.  Confidence  bounds;  fixed  R. 
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Figure  3. 1 


By  the  transformation  of  variables.  If  re$t  is  a constant,  p Is  a 
random  variable  with  known  distribution,  and  p Is  a random  variable  with  known 
distribution  from  prediction  data  quality  studies,  then  Rtrue  * rest  + ° +e  Is  a 
random  variable  with  a definable  statistical  distribution  function.  In 
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particular.  If  p Is  distributed  as  normal  with  mean  0 and  standard  deviation 
(abbreviated  as  p d.a.  N(0,ap)),  and  e d.a.  N(0,oe),  then 
R d.a.  N(res^,  (pp^  + a£2) 1/2)  which  defines  an  overall  probability  of  survival 
curve  Q(i,j)  that  incorporates  both  physical  variation  and  analytic  uncertainty. 

Let  Q{.,  .)  be  the  probability  of  survival  of  the  entire  node  under  all  effects, 
with  values  of  the  Independent  variables  that  modulate  the  nuclear  effect  given 
by  the  scenario.  Under  the  simplifying  assumptions  that  survival  of  each  subunit 
of  equipment  Is  statistically  Independent  from  the  survival  of  any  other 
subunits,  and  survival  under  the  stress  of  each  effect  is  statistically 
Independent  of  the  survival  under  the  stress  of  other  effects,  and  all  subunits 
are  necessary  serial  parts  of  the  system  that  constitutes  the  node,  the  effects 
may  be  Integrated  using  the  relationship 

e s 

Q( . , .)  * it  n Q ( 1 , j).  (3.1-1) 

j=l  i»l 

This  probability  of  survival  formulation  Is  useful  for  first  order 
approximations  even  If  Independence  is  a questionable  assumption.  As  an  example, 
if  any  0(1,  j)  Is  0.  the  node  will  not  survive.  Prior  to  making  completely 
detailed  calculations.  If  one  subunit  of  equipment  is  suspected  to  be  vulnerable 
to  a nuclear  effect,  analysis  of  the  subunit  may  suffice  to  demonstrate 
vulnerability  of  the  entire  node. 

Similarly,  to  Investigate  the  survivability  of  one  subunit  of 

e 

equipment  using  the  relationship  (Q(1,  .)  = n 0(1,  j),  it  may  suffice  to 

j"l 

Investigate  only  the  nuclear  effect  j which  Is  suspected  of  being  the  most 
damaging  or  for  which  results  are  readily  calculated  and  suspected  to  give  a 
near  zero  probability  of  survival.  For  example,  a long  analysis  of  ground  shock 
effect  on  an  antenna  Is  not  Important  for  a survivability  study  If  a two  minute 
calculation  shows  a high  probability  that  the  antenna  Is  damaged  by  heat. 
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The  assumption  of  Independence  between  probabilities  of  survival  may 
be  valid  for  many  effects  and  subunits  of  equipment.  In  other  cases,  strong 
dependence  may  be  expected.  If,  for  example,  the  subunits  are  electronic  units 
In  the  same  building  and  effect  j is  blast  dynamic  pressure,  and  If  the  building 
collapses  and  crushes  box  1,  there  Is  very  high  probability  that  box  1 + k will 
also  be  crushed.  For  this  example,  Q(i  + k,  j 1,  j)  3 1;  that  Is,  the 
probability  of  survival  of  equipment  unit  1 + k to  effect  j,  given  the  survival 
of  equipment  unit  1 to  effect  j.  Is  close  to  one. 

As  another  example,  analytical  and  physical  uncertainty  errors  for 
blast  may  be  expected  to  be  positively  correlated  with  similar  errors  developed 
In  analyzing  for  shock  effects,  due  to  a common  relation  to  physical  strength. 

Here  Q(i,  j + h|i,  j)  Is  expected  to  be  greater  than  the  unconditioned 
Q(i,  j + h). 


The  analysis  of  the  node  probability  of  survival  under  assumed 
statistical  dependence  can  become  complicated  if  there  are  significant  numbers 
of  values  of  Q which  are  neither  nearly  0 nor  nearly  1.  The  sequence  of 
conditional  events  and  their  careful  definition  become  Important  for  these 
situations.  For  an  assumed  serial  set  of  equipment, 

Q( . ,.)  = Q(1,1)*Q(1,2|{1,1})*Q(1,3|{1,1M1,2})*Q(1,4|U,1M1,2},{1,3»*  ... 
*0(2,1 Ul,. })*Q(2,2 | Tl,. >,t2,l >)*Q(2,3 | { 1 , . ) , f 2 ,1-2 >)*  ... 

*Q( i 1 , j > I all  (k,h)  where  [k  < 1]  or  [k  * 1 and  h < j])*  .... 

*Q( Ts ,e> I all  f k ,h > where  k s s,  h < e)  (3.1-2) 

where  * denotes  multiplication  and  the  event  i , j is  the  event  that  subunit  i 
survives  the  Isolated  subeffect  j. 

3.1.4  Example 

To  Illustrate  the  above  scenario  method  of  Integrating  nuclear  effects 
for  probability  of  survival  estimation,  the  following  example  with  hypothetical 
values  and  relationships  will  be  developed. 
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Let  the  scenario  burst  be  a single  1 megaton  burst  at  a height  of  100 
meters  with  a .X  fission  fraction  and  a Y.Y  KEY  X-ray  temperature  and  a .ZZ 
X-ray  fraction.  Assume  the  burst  Is  over  level  land  at  a latitude  of  48°  21 ’ N 
and  a longitude  of  122°  40' W at  1433  hours  GMT  on  2/31/84.  The  surface  Is  grass 
covered  land  overlaying  glacial  deposits  of  moderate  sized  gravel  and  clay,  over 
a point  at  a horizontal  range  of  150  meters  due  north  from  the  center  of  a 
target  facility. 

Let  the  node  being  assessed  consist  of  all  equipment  necessary  to 
perform  high  frequency  ( HF ) receive  and  transmit  functions,  operating  out  of  a 
rectangular,  above-ground  concrete  slab  building  with  reinforcing  bar, 
dimensioned  30  meters,  north  to  south,  40  meters,  west  to  east,  and  10  meters 
high.  Let  the  burst  be  part  of  a surprise  attack  with  no  special  preparations  or 
readiness. 

Let  the  subunits  of  equipment  be  1)  the  antenna,  2)  the  multiplexer, 

3)  the  receiver,  4)  the  teletype,  5)  the  transmitter,  and  6)  the  power  supply. 
Let  the  equipment  be  operating  at  H hertz,  using  FSK  over  50  channels,  all 
equipment  on  line  without  ready  spares. 

Let  survival  of  the  node  at  any  point  In  time  be  defined  as  the 
ability  to  transmit  and  receive  10  or  more  channels  with  90%  of  full  signal 
power  and  bit  error  rate  < 1/100  bits.  Assume  that  to  meet  this  definition  of 
survival  all  subunits  of  equipment  must  be  operating. 

Let  the  total  effect  be  analyzed  in  terms  of  the  subeffects  blast, 
shock,  thermal,  radiation,  dust,  ejecta,  EMP,  MHD,  and  psychological  and 
physical  effects  to  personnel.  The  matrix  of  equipment  and  effects  Is  as  defined 
In  Table  3.1-1. 


Table  3.1-1.  Basic  equipment/effect  analysis  table 


As  an  example  of  the  analysis  leading  to  the  characterization  of  one  matrix 
entry,  a hypothetical  analysis  of  the  effect  of  neutron  and  gamma  radiation  on 
the  transmitter  will  be  presented.  Let  the  fluence  be  b units/cm^  at  the 
building.  Analysis  predicts  the  attenuation  to  be  30  dB  If  the  transmitter  Is  In 
electronics  rack  4.  The  prediction  accuracy  Is  characterized  by  prediction  error 
that  Is  normally  distributed  with  mean  0 dB  and  standard  deviation  10  dB.  The 
transmitter  response  to  radiation  Is  permanent  degradation  of  a semiconductor 
component  which  has  the  functional  effect  of  complete  transmitter  failure  if 
neutron  fluence  of  the  component  exceeds  approximately  S units/square  cm.  The 
logarithm  of  this  failure  level  varies  among  similar  semiconductors  and 
transmitters  by  an  approximately  normally  distributed  variate  N(0,4). 


It  Is  convenient  to  characterize  the  radiation  effect  In  terms  of  a 
safety  margin  (SM)  where  SM  * 20  log  (threshold/threat  magnitude).  The  estimate 
of  the  mean  value  of  safety  margin  Is  SM  « 20  log  (S)  - (20  log  b - 30)  where 
the  true  unknown  safety  margin  Is  normally  distributed  about  this  estimate  with 
standard  deviation 


Effects 

1 2 3 4 5 6 7 8 9 

Equipment  Blast  Shock  Thermal  Radiation  Dust  Ejecta  EMP  MHO  Personnel 

1)  Antenna 

2)  Mux 

3)  Rcvr 

4)  TTY 

5)  XMTR 

6)  PS 

7)  Personnel 
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This  follows  from  the  fact  that  If  X d.a.N(uX ,oy)  and  Y d.a.N(uv.ay) . 

9 9 \/9 

then  X i Y d.a.N(ux  i uY.(ax  + «{)')•  Therefore,  if  SM  » 8 dB,  then 

Pr{SM  > 0)  * Q ( 5 , 4 ) * .77  for  the  transmitter  with  radiation  considered  alone  as 

Illustrated  In  Table  3.1-2. 

Assuming  the  above  type  of  Information  Is  available  and  the  analysis 
Is  performed  for  all  the  effects  and  equipment,  the  matrix  can  be  filled  In  with 
all  the  unconditional  probabilities  Q(i,  j)  as  illustrated  In  Table  3.1-2. 

Table  3.1-2.  Example  equipment  effect  analysis. 

Effect 


Equipment 

1 2 

Blast  Shock 

3 

Thermal 

4 

Radiation 

5 6 7 

Dust  Ejecta  EMP 

8 

MHD 

9 

Psych 

Q( 1 . - ) 

1)  Ant 

.95 

.7 

.8 

1 

1 

.99 

.99 

1 

1 

.52 

2)  Mux 

.8 

.9 

.48 

.5 

1 

.99 

.4 

1 

1 

.06 

3)  Rcvr 

.8 

.9 

.97 

.98 

1 

.99 

1 

1 

1 

.68 

4)  TTY 

.8 

.9 

.99 

1 

1 

.99 

1 

1 

1 

.71 

5)  XMTR 

.8 

.9 

.8 

.77 

1 

.99 

1 

1 

1 

.44 

6)  PS 

.8 

.9 

.99 

1 

1 

.99 

1 

1 

1 

.71 

7)  Personnel. 75 

.9 

.9 

.9 

1 

.99  - 

1 

1 

.83 

.45 

Q(.J) 

.23 

.37 

.26 

.34 

1 

.93 

.4 

1 

.83 

.002=Q( . ,.) 

The  entries  In  Table  3.1-2  allow  for  the  definition  of  a first-order 
approximation  to  the  probability  of  survival  of  the  node  assuming  Independence. 
For  this  example,  as  defined  In  equation  3.1-1,  Q( . . . ) * .002.  If  Q( . , . ) had 
been  1,  or  If  all  vulnerability  Is  due  to  one  term  or  to  statistically 
Independent  terms,  the  first-order  approximation  analysis  would  be  sufficient. 

I 

Assuming  that  there  are  some  known  dependencies  between  effects  and 
between  equipments,  a matrix  of  conditional  probabilities  of  survival. 


0( { 1 , j > | all  {k,h,}  where  [k  < 1]  or  [k  ■ 1 and  h < J]), 
can  be  created  as  Illustrated  In  Table  3.1-3. 


. j 


Table  3.1-3.  Statistical  dependence  example  of  equipment  effect  analysis 
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- As  an  example  of  the  interpretation  of  entries  in  Table  3.1-3,  the  {3,3}  entry, 

.99,  is  the  probability  that  the  receiver  survives  thermal  effects  given  that  it 
survives  shock  and  blast  effects,  and  given  that  the  antenna  and  multiplexer 
survive  all  effects.  From  entries  In  this  table,  an  estimate  of  the  probability 
of  survival  of  the  node  can  be  calculated  using  Equation  3.1-2;  the  result  is 
()’(.,.)  * .068  where  Q'(.,.)  Is  the  probability  of  survival  of  the  node 
containing  serially  dependent  equipment  for  which  the  probabilities  of  survival 
are  statistically  dependent. 

The  calculation  of  the  conditional  probabilities  may  be  straight- 
forward based  upon  logical  and  physical  dependencies  such  as:  “If  the  TTY 
survives  blast,  then  the  TTY  will  survive  shock."  Other  calculations  of 
conditional  probabilities  may  require  substantial  modeling  investigation  of 
covariances  among  variables,  from  information  such  as:  "The  dB  errors  in 
analysis  of  attenuation  of  thermal  effects  have  a correlation  coefficient  o » .8 
with  dB  errors  In  the  analysis  of  attenuation  of  beta  radiation."  Such 
correlation  data  might  be  used  to  calculate  conditional  probabilities, 

Q(  (1  ,j ) | (1  ,h  > ) . 

I 

The  value  of  Q({1,j}  | (1,h})  may  be  determined  by  Monte  Carlo 
simulation.  Correlated  pseudo-random  numbers  may  be  generated  for  modeling 
uncertainty  errors  for  j and  h.  The  resulting  Q((1,j})  and  Q( T i ,h> ) pairs  that 
are  so  generated  may  In  turn  be  used  for  generating  pairs  of  Bernoulli  random 
variables  that  may  be  used  in  a counting  algorithm  to  estimate  Q({1,j}  and 
{1,h}).  The  average  of  these  estimates  of  Q({1,j)  and  {1,h})  can  be  used  to 
calculate  Q({1,j}  | { 1 ,h> ) from  the  definition  of  conditional  probability 

Q(ij>  i (i,h»  - Q((  ■$ffi;SV1,h}1 


- a . 

It  may  be  possible  to  determine  the  values  of  Q((1,j}  | ( 1 ,h))  using 


3.2 


FUNCTION  OF  INDEPENDENT  VARIABLE  APPROACH 


The  various  nuclear  effects  are  individually  and  functionally 
dependent  on  several  scenario- type  Independent  variables  such  as  range, 
altitude,  etc.  If  one  (or  several)  of  the  Independent  variables  Is  selected  for 
analysis,  and  the  probability  of  survival  Is  determined  over  the  values  of  this 
variable  with  all  other  variables  held  constant,  a useful  conceptualization  of 
vulnerability  relationships  may  be  obtained. 

The  following  discussion  will  concentrate  on  the  one  variable  approach 
Illustrated  In  Figure  3.2-1.  Extension  to  the  n-varlables  would  follow  similar 
lines;  such  extensions  are  conceptually  described  In  Figures  3.2-2  and  3.2-3. 


Figure  3.2-1.  Example  of  one  variable  survival  relation. 


Height 


Figure  3.2-2.  Example  of  two  variable  survival  relation. 
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The  remarks  presented  In  Section  3.1  regarding  series  structures  and 
statistical  dependence,  and  their  Impact  on  the  form  of  survivability  functions, 
apply  also  to  the  material  presented  In  this  section. 

The  "function  of  a variable"  approach  discussed  here  may  use  any  of 
the  Independent  variables.  For  concreteness  of  discussion,  the  particular 
Independent  variable  assumed  here  will  be  the  range  from  target  to  actual  ground 
zero.  This  parameter  was  chosen  for  the  discussion  due  to  its  dominant  role  In 
determining  the  magnitude  of  several  of  the  effects  from  the  INCA  list  of 
nuclear  effects,  which  Includes  blast,  thermal,  radiation,  EMP,  shock,  dust, 
ejecta,  and  MHD.  Having  analyzed  the  probability  of  survival  as  a function  of 
range  allows  ready  evaluation  under  various  assumptions  of  targeting  accuracy, 
and  the  analysis  can  be  helpful  In  evaluating  probable  collateral  effects  on  the 
site  If  It  should  happen  not  to  be  the  designated  target  but  Is  close  to  another 
target. 

There  Is  more  than  one  method  of  creating  the  Integrated  probability 
of  survival  for  multiple  effects  over  the  range  of  an  Independent  variable.  One 
method  Is  to  use  the  scenario  method  described  In  Section  3.1  and  Iterate  the 
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scenario  through  the  appropriate  values  of  range  to  determine  a set  of 
relationships  that  define  the  Q(r)  functional  form.  If  the  single  scenario 
analysis  logic  has  already  been  developed,  this  method  may  well  be  the  most 
straightforward  and  satisfactory. 

A second  method  Is  to  develop  the  probability  of  survival  as  a 
function  of  range  for  each  nuclear  effect  individually.  Under  appropriate 
conditions  of  statistical  dependency,  the  individual  functions  may  be  combined 
to  estimate  the  probability  of  survival  of  the  node  to  all  effects;  this  method 
is  developed  further  in  the  following  paragraphs. 

For  any  one  effect  and  unit  of  equipment,  the  threshold  and  threshold 
uncertainties  must  be  determined  as  shown  in  Figure  3.2-4.  The  nuclear  effect 
response  and  response  uncertainties  at  the  equipment,  Figure  3.2-5,  must  also  be 
determined.  The  probability  of  survival  relationship.  Figure  3.2-6,  is 
determined  as  before  from  the  threshold  and  response  relationships  together  with 
the  associated  uncertainties. 


Effect 

Level 


Range 


Figure  3.2-4.  Threshold;  Tj  ■ hj(r). 


38 


3.2.2 


Statistical  Dependence  Considerations 


The  outline  development  above  assumes  that  all  physical  variabilities 
and  estimation  uncertainties  in  analysis  are  incorporated  in  the  survival 
probability  function  curve  and  assumes  statistical  independence  between 
equipment  and  between  effects. 

If  statistical  dependencies  exist  between  equipment  or  effects,  the 
analytical  inclusion  of  these  dependencies  will  most  likely  be  complicated.  For 
the  simple  case  where  strong  positive  correlation  exists  between  the 
probabilities  of  survival  for  n subcategories,  n-1  of  the  values  (curves)  of  Q 
can  be  omitted  and  a good  approximation  obtained.  Probabilistically,  this 
follows  from  the  fact  that  if  P(B 1 A)  * 1 and  P(C|A‘B)  = 1,  then  P(A'B'C)  * 
P(A)P(B|A)P(C| AB)  * P( A) . 

If  moderate  statistical  dependence  exists  between  equipment  or 
effects,  the  parameter  estimat'on  and  the  correct  algorithms  for  integration 
become  more  complicated.  The  scenario  iteration  method,  using  the  dependence 
techniques  described  in  Section  3.1,  may  be  the  best  way  to  proceed. 

For  the  independent  variable  approach,  the  correct  dependency 
relationships  must  be  analyzed  from  the  covariation  in  the  uncertainties  in  the 
predicted  threat  environments  and  the  covariation  in  the  uncertainties  in  the 
predicted  thresholds,  as  described  in  Section  3.1.  The  mappings  and 
transformations  of  variables  into  the  conditional  survival  probabilities, 
Q((i,j})  | all  f k ,h>  ■*  k i 1,  h < j),  will  in  general  result  in  the 
relationships  among  conditional  probabilities  changing  at  different  values  of 
the  independent  variable,  requiring  simplifying  assumption  or  re-evaluation  of 
the  conditional  probabilities  at  each  value  calculated. 
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4.0  CONCLUSIONS 


The  determination  of  an  overall  assessment  statement  for  a 
communication  facility  requires  two  steps.  The  first  Is  the  determination  of  the 
data  quality  and  survival  confidence  for  each  specific  nuclear  effect,  and  the 
second  Is  the  Integration  of  the  Information  for  various  specific  effects  Into 
the  overall  assessment  statement. 

Four  techniques  which  can  be  applied  to  the  determination  of  the  data 
quality  and  confidence  for  a specific  nuclear  effect  have  been  defined;  they 
are: 


1)  A test  verification  technique  which  uses  analytical  predictions 
and  test  measurements. 

2)  A method  of  moments  technique  which  can  be  used  whenever 
analytical  expressions  are  available. 

3)  A sensitivity  analysis  technique  which  can  be  used  to  exclude  from 
further  consideration  components  of  a facility  which  are 
unaffected  by  the  "worst  case"  of  a specific  nuclear  effect;  the 
technique  can  also  be  used  to  select  the  combinations  of 
components  and  nuclear  events  which  are  most  significant  with 
respect  to  survival  confidence. 

4)  A full  scale  o'*  limited  simulation  technique  which,  although 
attractive  because  It  Is  an  analytical  simulation  of  a complete 
test,  suffers  from  errors  in  an  Imperfect  model,  and  Is  often  the 
most  expensive  way  of  obtaining  the  required  data  quality/survival 
confidence  information. 


Two  techniques  have  been  defined  which  can  be  applied  to  the 
Integration  of  the  Information  for  various  specific  effects  Into  an  overall 
assessment  statement;  they  are: 

1)  A defined  scenario  technique  which  specifies  the  environment 
characteristics  such  that  particular  nuclear  effects  are  defined 
In  a sequence  so  that  the  Integrated  assessment  results  can  be 
presented  In  the  form  of  a time  history. 

2)  A function  of  Independent  variable  technique  which  provides  for 
Investigations  with  all  but  one  of  the  variables  held  constant. 
This  technique  provides  Insight  Into  the  conceptual  nature  of  the 
functional  dependencies  that  are  Indepedent  of  the  scenario. 

All  the  techniques  defined  within  this  report  have  assumed  statistical 
Independence;  In  some  cases  the  effect  of  statistical  dependencies  are 
Illustrated.  When  the  assumption  of  statistical  Independence  Is  Invalid, 
standard  techniques  for  calculating  covariance  and  correlation  must  be  employed. 
When  these  determinations  are  computationally  Impractical,  scenario  Iteration 
can  be  used. 
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5.0  RECOMMENDATIONS 

1)  The  existing  INCA  data  base  should  be  utilized,  and  expanded  as 
required,  to  allow  for  a comparison  and  evaluation  of  the  various 
techniques  defined  In  this  document. 

2)  The  statistical  characterization  of  the  uncertainties  (l.e.  data 
quality)  should  be  determined  and  used  whenever  predictions  are 
developed.  The  theorej^fal  foundations  of  the  data  quality  concept 
were  documented  Ip-^SurvIvabl  11  ty /Vulnerability  Safety  Margin 
Assessment,"  PfJA  3859Z,  September  1975,  and  were  expanded  In 
“Responsjx^redlctlon  Characteristics,  Data  Quality  and  Related 
Topics,"  D194-10021-1,  September  1977.  These  results,  as  well  as 
those  results  and  techniques  presented  in  other  documents,  reports 

^<**and  papers  addressing  the  subject,  should  be  documented  in  a 
> self-contained  discussion  In  a form  readily  comprehensible  to 
nonstatisticians  and  to  readers  entirely  unfamiliar  with  the  data 
quality  concepts. 

3)  The  material  contained  In  the  documents  discussed  in  2)  above 
should  be  used  to  prepare  lecture  notes  and  visual  aids  to  be  used 
during  seminars  In  assessment  techniques.  This  material  would  be 
designed  for  nonspecialists  and  would  Include  the  elementary 
statistics  required  tj  develop  and  apply  the  data  quality  concept. 
In  addition,  the  material  would  serve  to  establish  a unified 
language  and  notation  for  the  several  contractors  and  governmental 
agencies  associated  with  the  INCA  Program. 
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APPENDIX  A 

REQUIRED  SAMPLE  SIZE  FOR  VARIANCE  ESTIMATION 

Given  a random  variable,  X,  It  Is  then  desired  to  characterize  the 
spread  In  the  distribution  of  X.  A sample  of  n values  of  xj  Is  to  be  taken  to 
provide  data;  thus,  the  required  value  of  n must  be  determined.  Though  range  or 
Interquantlle  range  may  be  used  to  characterize  spread,  the  most  commonly  used 
statistic  for  spread  Is  the  variance,  or  second  moment  about  the  mean. 

The  population  variance  of  X,  ox2,  Is  defined  by 
ox2  «_£*(X-ux)2  f ( X ) dx  for  continuous  distributions  or  £x  (X  - ux)2  f (X)  for 

discrete  distributions.  The  sample  Information  may  be  used  to  estimate  the  _ 

r(Xi  - X)2 

population  variance.  An  unbiased  estimate  of  variance  Is  ®2X  » s2  * — n _-■} — . 

To  determine  what  sample  size  Is  needed  to  estimate  the  variance  with 
a given  precision,  the  relationship  among  ax,  s,  and  n must  be  known.  If  the 
form  of  a population  distribution  Is  known,  or  can  be  hypothesized  and  shown  to 
be  a reasonable  assumption  or  approximation,  the  relationship  between  °x,  s,  and 
n may  be  calculated.  In  particular.  If  X Is  a normally  distributed  random 
variable  with  mean  ux  and  standard  deviation  °x,  and  a sample  of  size  n from  the 
population  of  X gives  a variance  estimate  sx2,  then  the  random  variable 
(n-1)  sx2  has  a x2  distribution  with  n-1  degrees  of  freedom.  Therefore,  If  It  Is 
desired  to  select  a sample  size  large  enough  so  there  Is  only  a probability  « 

that  Sx  Is  less  than  jx  by  more  than  p%,  or  Pr  j \ ' “ * TOO  | “ “•  then 

Pr  t^n-l  X (1  - p/100)2(n-l)}»  a.  The  solution  then  consists  of  finding  the 
smallest  n such  that  x^_j.  « S (l-p/100)2{n-l). 

For  example,  to  assure  a 0.0S  probability  or  less  that  Sx  Is  less  than 
7X  by  more  than  10%,  a sample  size- close  to  200  Is  needed.  To  assure  a 0.10 
probability  or  less  that  Sx  Is  less  than  <*x  by  more  than  25%,  a sample  size  of 
16  Is  required. 


4S 


The  normal  distribution  case  may  be  used  for  an  approximation  of 
required  sample  sizes  for  variance  estimation  for  other  distributions.  If  they 
are  approximately  normally  distributed.  Exact  probability  distributions  of  the 
sample  variance  for  non-normal  distributions  are  not  widely  published. 
Alternatively,  distribution-free  methods  may  be  used  to  place  confidence  bounds 
on  population  spreads  based  upon  sample  data,  though  due  to  their  generality 
they  can  result  In  unrealistically  large  bounds  or  large  sample  sizes. 
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APPENDIX  B 
SYSTEM  SURVIVAL 


B.I  SERIES  SYSTEM  SURVIVAL 


If  a system  fs  a functional  series  of  units,  every  unit  in  the  system 
must  function  in  order  for  the  system  to  function,  and  the  unit  survival 
probabilities  are  statistically  Independent,  then  the  probability  of  system 
survival  is  the  product  of  the  unit  probabilities  of  survival;  that  Is, 


n 

Q$  a Qi  • Q2  • Q3  ***  Qn  * n Q< 

1*1 

where 


Qs  * probability  of  system  survival 
Qi  * probability  of  unit  "1"  survival 


B.2  PARALLEL  SYSTEM  SURVIVAL 


If  a system  Is  a functional  combination  of  units  in  parallel,  so  that 
the  system  will  function  If  any  unit  functions,  and  the  unit  survival 
probabilities  are  statistically  independent,  then  the  probability  of  system 
survival  Is  a function  of  a union  of  events. 


Qs  * Pr  junlt  1 survives  OR  unit  2 survives  OR  ... 
i ...  OR  unit  n survives 

n 

• 1 - n (1  - Qi ) 

1-1 
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B.3 


K OUT  OF  N SYSTEM 


If  a system  operates  whenever  at  least  k out  of  n units  operate,  and 
the  unit  survival  probabilities  are  statistically  Independent,  then  the 
probability  of  system  survival  Is  the  sum  of  the  probabilities  of  survival  for 
combinations  k or  more  surviving  units;  that  Is, 


Qs  - E I 

1-k  all  combinations 
of  1 survivors 


[ n Qj  n (1  - Qj)l 

[jel  j*1  J 


where  denotes  that  j is  an  element  of  1 and  *t*  denotes  that  j is  not  an 
element  of  1. 


In  a simple  case  where  n ■ 3 and  k * 2,  the  above  equation  simplifies  to: 


Qs  ■ Q1Q2  U-Q3)  + Qi  U-Q2)  Q3  + U-Qi)  Q2Q3  + QlQ2Q3- 


COMPLEX  SERIES  - PARALLEL  SYSTEMS 


Techniques  for  evaluating  complex  systems  of  parallel  and  series  units 
can  be  found  In  design  reliability  textbooks  (reference  8).  Simple  system 
combinations  can  be  analyzed  In  a straightforward  manner.  For  complex  systems 
exact  computation  can  be  a formidable  task;  bounding  algorithms  or  computer 
solution  from  event  tree  diagrams  can  be  used  in  those  cases. 
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